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TY Is wWeLt. known that the “higher” 
I thought processes, more generally 
subsumed under the rubric of problem 
solving, have not received the experi- 
mental attention from psychologists that 
they merit. 

In a recent appraisal of research on 
thinking, Underwood concludes 
that a great deal of the future develop- 
ment in thinking rests squarely on filling 
the hiatus representing lack of empirical 
relationships between stimulus variables 
and response changes for tasks said to be 
measuring thinking” (5, p. 211). 

Contradiction of the foregoing state- 
ment by Underwood is indeed difficult. 
If Underwood's “formula” is correct, 
clear-cut relationships between environ- 
mental variables and specific response 
changes in problem-solving tasks are a 
basic requirement. 

It might be well at this point to con- 
sider the nature of response changes in 
relation to problem-solving research. 
Most problem-solving studies compare 
various groups of problem solvers on the 
basis of (a2) number of problems solved 
correctly and (b) time taken to solve a 
problem. That time is in some cases a 
dubious criterion is pointed out in re- 
cent problem-solving investigations (1, 
4)- 

The use of number of problems cor- 
rectly solved is, of course, a valid re- 


sponse measure. It is, however, an end 
result which yields no information with 
reference to describing the behaviors or 
response categories that are important 
during the actual problem-solving proc- 
ess. 

The lack of sophisticated response 
measures in problem-solving research is 
clear. Before environmental manipula- 
tions can be related to response measures 
in problem-solving studies, more ade- 
quate response measures must be devel- 
oped. It is not sufficient to describe the 
“good” problem solver as simply one 
who solves the most problems in a given 
situation, 

A primary need in the area of problem 
solving, then, is an objective description 
of the behaviors exhibited by the more 
proficient problem solvers, as contrasted 
with the less proficient problem solvers, 
while in the actual process of solving 
problems. 

A focal problem in the present paper 
was to investigate selected response di- 
mensions and determine their relative 
usefulness in differentiating between 
problem solvers of varying ability levels. 
In addition to it was 
proposed to study under specified condi- 


time measures, 
tions such response concepts as (a) pat- 
terns of search, (b) stereotypy of re- 
sponse, and (c) error distance. 

It has often been suggested in various 
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portions of the problem-solving litera- 
ture that good problem: solvers are less 
stereotyped in their approach than the 
poorer problem solvers. Proposals have 
been offered to the effect that pattern of 
search or “how” the problem solver goes 
about his task is somehow related to efh- 
ciency. This supposition leads directly 
to the question of whether good prob- 
lem solvers employ a different search 
pattern from the less proficient problem 
solvers. 

The error-distance concept appeared 
worthy of investigation for the following 
reason. When the term “success” is used 
with reference to solving a problem, it 
is implied that the problem solver was 
absolutely correct. However, it is pro- 
posed that degrees of correctness be con- 
sidered as a possible parameter in prob- 
lem-solving situations. For example, two 
persons are required to solve a problem. 
Both respondents give erroneous solu- 
tions when an absolute standard of cor- 
rectness is applied. However, Problem 
Solver A is extremely close to a correct 
solution, while Problem Solver B misses 
the solution by a wide margin. For this 
reason, it was decided to make a thor- 
ough analysis of whether the more pro- 
ficient problem solver, although incor- 
rect in his solution, was consistently less 
in error distance than the less proficient 
problem solvers. 

The foregoing response dimensions of 
time, pattern of search, response stereo- 
typy, and error distance were studied in 
two broad groups of problem solvers, 
classified with respect to proficiency, as 
being either “good” or “poor” problem 
solvers. The basic problem was to study 
the relationship between these particular 
response indices and problem-solving 
proficiency. 

A subsidiary consideration was to de- 
termine to what extent problem solvers 


of varying proficiency levels modify their 
“responses” when training and practice 
factors are common to all problem solv- 
ers. Stated another way, we wished to 
determine the extent to which the re- 
sponse dimensions under study were 
modifiable under conditions of similar 
training and practice. It seemed impor- 
tant to learn whether those subjects ini- 
tially classified as poor problem solvers 
become less stereotyped when compared 
with their original stereotypy indices. 

Simply then, it is the purpose of 
this paper to describe the behaviors 
good problem solvers exhibit but that 
poorer problem solvers apparently 
lack. Conversely, the poor problem 
solver may exhibit certain characteristics 
that the good problem solver lacks. A 
secondary purpose is to gain an indica- 
tion of whether the initially poor 
problem solver tends to resemble the 
good problem solver when training 
and practice factors are introduced. 


METHOD 
Apparatus 


The apparatus used is shown in 
Figure 1. It is referred to as the gear-train 
apparatus, designed for exploratory re- 
search in the development of problem- 
solving response measures, The gear train 
consists of sets of gears and shafts 
mounted on a sheet of aluminum 1/2 
inch thick, 29 inches long, and go inches 
wide. The gear trains were designed so 
that two series and four parallel chan- 
nels were formed, providing for crossed 
information chains. 

Two operating control handles, la- 
beled A and B, supplied the input neces- 
sary to set the gear train in motion. The 
motion was transferred through the gear 
trains and, as an end result, activated 
a switch that caused a series of red lights 
to illuminate the control panel. 
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Fic. 1. The gear-train apparatus, 


These red lights would illuminate 
only if the gear train was working prop- 
erly and if control A was turned 13 revo- 
lutions and control B was turned 13 
revolutions. 

When the required number of revolu- 
tions was made and the end result (il- 
lumination of control panel) failed to 
occur, this indicated to § that something 
was wrong in the gear train. The prob- 
lem for $ in each case was to locate the 
defect or malfunction. 


Problems or Malfunctions 


For the purposes of this investigation, 
five classes of problems or malfunctions 
were utilized: (a) a gear not meshing due 
to a gap between gears, (b) a slipping 
gear due to a set screw having been re- 
moved, (c) a damaged cog, or broken 


gear, (d) “special” problems, such as de- 
fects introduced into one of the differ- 
entials, and (¢) problems referred to as 
“no-defect” problems, i.e., nothing was 
actually wrong with the equipment. 


Classification of Subjects 


The subjects used in this study were 
49 adults enrolled in the School of Edu- 
cation at Indiana University during the 
1953 summer session. Participation in 
the experiment was required of all Ss. 

Each § spent approximately 2 hours 
in the experimental situation, 


Procedure 

The investigation was divided into 
three “test” phases: the initial or pre- 
test, intertest, and posttest. Each S$ was 
given six problems or malfunctions to 
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solve during each of the three problem- 
solving phases, making a total of 18 
problems that each § was confronted 
with. 

The 49 Ss were divided into two initial 
groups on the basis of their performance 
on the six pretest malfunctions. The 
first group, Group I, included all Ss who 
successfully solved at least three of the 
initial six problems; the second group 
included all others, This latter group 
was then subdivided into two groups on 
the basis of the difference between their 
pretest scores and their posttest scores. 
Those who demonstrated an improve- 
ment of at least two malfunctions be- 
tween the pretest and the posttest were 
classified into Group II, or poor “im- 
proved” problem solvers. All other Ss 
remained in Group III, or poor “unim- 
proved” problem solvers. 

The Ss were run individually. Imme- 
diately upon entering the experimental 
situation for the initial phase, S$ was 
given the standard operating procedure 
(SOP) for the gear-train apparatus. The 
SOP consisted of turning contro] handles 
A and B, 13 and 13 revolutions respec- 
tively; if the control panel failed to il- 
luminate, this indicated to § that the 
equipment was malfunctioning. The re- 
quired solution in each case was the cor- 
rect location of the malfunction. 

After the SOP orientation, S was given 
a series of six malfunctions to locate. 
Performance on these six problems con- 
stituted a measure of initial ability in 
this specific situation for each S. Each 
problem in the series was given singly; 
§ waited in an adjoining room while 
each succeeding problem was being in- 
serted into the apparatus by E. The Ss 
were allowed 4 minutes to solve each 
problem. There was an interval of 1 
minute after each problem. This was 
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necessary to allow E to prepare the next 
problem for S. 

The Ss were not required to give an 
answer and, in addition, they were free 
to give up prior to the 4-minute time 
limit set on each problem. After S had 
performed on the initial six problems 
that were administered to determine ini- 
tial levels of problem-solving ability on 
the gear train, the first phase of training, 
in the form of a tape-recorded “basic 
knowledge” lecture approximately 6 
minutes long, was individually adminis- 
tered to each S. This lecture was played 
twice for each S. Integrated with the 
lecture was a series of 35-mm. slides pro- 
jected on a screen. The rationale of this 
lecture was to convey the basic nomen- 
clature of the gear train. Included were 
the concepts of transfer of motion, func- 
tion of gears, bearings, and shafts. A 
zero time interval existed between the 
basic knowledge lecture and the inter- 
test, which consisted of S’s being adminis- 
tered a second series of six gear-train 
problems. 

A 24-hour interval existed between the 
intertest and the third series of prob- 
lems. Upon returning to the laboratory 
the following day, S was first given addi- 
tional training in the form of a 714-min- 
ute tape-recorded lecture on principles of 
problem solving specific to the gear 
train. This problem-solving lecture was 
based on a simplified version of a previ- 
ously developed symptom analysis guide 
to “trouble-shooting.” The _ lecture, 
which was played twice for each S, 
stressed starting with the greatest magni- 
tude of error, locating the correctly oper- 
ating component nearest the greatest er- 
ror, and once these two points were 
bracketed, the malfunction 
somewhere between. Following this sec- 
ond training session S was given a third 
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series of six gear-train problems. This 
was the final series of problems for each 
S and constituted the posttest measure. 

All moving parts of the gear train were 
numbered. These numbers ranged from 
i to 66, with the two operating handles 
labeled A and B. During each of the 18 
problems, S was required to call out the 
numbers of all parts he looked at, as he 
went from part to part in the process 
of attempting a correct solution. 

Responses were considered as correct 
only if S pointed to the exact location 
of the malfunction. Time measures were 
taken to the nearest 5 seconds. 


Response Measures 


The usual response measures of prob- 
lems solved and time were taken. Three 
additional classes of responses in the 
form of error distance, pattern of search, 
and behavioral stereotypy were recorded 
for all Ss. Descriptions of the three addi- 
tional response measures are given as 
follows: 


1. Error distance, For purposes of computation 
the gear train was classified into 25 functional 
units (FU), with each FU consisting of a shaft 
and all the gears on it, or of a differential, All 
“error distances” were based on the 25, FU’s of the 
gear train and computed on the basis of the 
number of “jumps” from FU to FU necessary to 
travel from the location of the response to the 
location of the malfunction, 

The scoring procedure for error distance was 
as follows. Correct answers were given an error- 
distance score of zero. Responses that identified 
the incorrect part as the malfunction but which 
were given in the correct functional unit were 
given error distances of 0.5. The no-defect prob- 
lems where an imaginary malfunction was “lo- 
cated” presented a special case. In those cases the 
no-defect problem was assigned to functional 
units o and 26. These may be thought of as the 
two control handles. Error distances from any 
responge were measured to the farther of these 
two locations. This method appears defensible be- 
cause the first task of the gear-train problem sol- 
ver is to apply the SOP in order to verify the ex- 
istence of a malfunction. Failure in this prelim- 
inary task ranks a subject below one who has suc- 
ceeded in this task but failed in a subsequent one. 
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2. Patterns of search. The total responses of 
each group on each of the 25 functional units 
for each of the 18 problems were tabulated, The 
18 problems or malfunctions were inserted in 
different parts of the 25 functional units, their 
various locations being determined by random 
sampling. The basic idea here was to compare 
how good and poor problem solvers pattern 
their responses. Clearly, the location of each 
defect was in one of the 25 functional units. The 
pattern-of-search measure entailed recording the 
frequency of occurrence of S’s going to each of the 
25, FU’s while in the process of locating each of 
the 18 malfunctions. 

3. Stereotypy of response. For purposes of ob- 
taining stereotypy indices the gear-train ap- 
paratus was redivided, for computational pur- 
poses, into six logically coherent clusters. There 
existed several open spaces between clusters or 
sets of gears, which permitted this convenient 
breakdown to six areas. It was desired to obtain 
stereotypy indices for the various groups of 
problem solvers for each of the three phases of 
the investigation. 

RESULTS 

1. Analysis of correct solutions, First, 
an analysis was made of the performance 
of the 49 Ss with respect to number of 
correct solutions for each of the three 
test phases. These data, condensed in 
terms of means, standard deviations, and 
F ratios, are shown in Table 1. 

The mean scores for each of the pro- 
ficiency groups were based upon a series 
of six problems during three test ses- 
sions. Thus the average problem solver 
in Group I (good problem solvers) gave 
3.5 correct solutions during the pretest, 
of a possible six correct solutions. 

The total test mean scores are indica- 
tive of the relative performances of the 
three problem-solving groups over the 
entire series of 18 problems. The remain- 
ing section of Table 1 summarizes the 
analysis of variance for differences 
among the three problem-solving groups. 
In addition to the analysis for total test 
differences, F ratios were computed for 
differences during the pre-, inter-, and 
posttest phases. The obtained F of 42.42 
for the pretest phase was significant be- 
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Total test 


Test t Phase = Soares of Variance | df 

Pretest Between groups Le 2 

| Within groups 46 

Intertest | Between groups 2 

Within groups 46 

Posttest Between groups 2 

| Within groups 46 

7 Total test Between groups 2 

| Within groups 46 


p<.05. 
** p< .o1. 


yond the 1 per cent level of confidence. 
It should be made clear that it was 
necessary to demonstrate at the outset 
that those classified as good problem 
solvers (Group I) were decidedly more 
proficient than those classed as poor 
problem solvers (Groups II and III). 
The foregoing F ratio of 42.42 estab- 
lishes statistically that these groups were 
initially different with respect to ability 
to solve gear-train problems. 

Immediately prior to the second series 
of problems, the intertest, all Ss were 
given a training session in the form of 
a basic knowledge lecture concerning 
the elements of the gear-train appa. atus. 
From the reduced F ratio for intertest 
differences it appears 
that this lecture had 
the less proficient problem solvers 
(Groups If and II). The obtained F 
ratio of 4.64 was, nonetheless, significant 


safe to conclude 
some effect upon 
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test problems correctly solved. Group II 
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TABLE 1 


ComMPARISON OF CorrECT SOLUTIONS By Ss CLAssiriep ACCORDING 
TO M-SOLVING PROFICIENCY 


7-3 2. 


| Group I Group II Group Ill 
Test Phase | Mean SD | Mean SD Mean SD 
Pretest 3-5 0.65 1.2 0.66 1.5 | 0.72 
Intertest 3.0 1.58 1.8 1.28 1.7 0.92 
Posttest 3.8 0.83 4.3 1.06 1.9 0.97 
| 10.3 
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“Analysis of Variance Results 


Mean Square 

21.21 42.42** 
©.50 

7.38 4.64" 
1.59 

29.53 29.53°* 
1.00 

103.77 21.09** 


.92 


at the 5 per cent level of confidence. The 
difference again favored the Group I 
problem solvers. This basic knowledge 
lecture probably contained little that 
Group I Ss did not already know and 
consequently was not a factor in their 
performance on the series of six intertest 
problems. On the other hand, Groups II 
and III made fractional mean gains, 
indicating that the basic knowledge 
training session was of some benefit. 

Prior to the final series of six gear- 
train problems, designated as the post- 
test, all Ss received a second training 
session in the form of a tape-recorded 
“How to solve gear-train problems” 
lecture. 

The obtained F of 29.53, significant 
beyond the 1 per cent level of confidence, 
indicated that differences existed among 
the three groups with respect to post- 
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TABLE 2 
MEANS AND STANDARD DEVIATIONS OF TIME IN SECONDS REQUIRED TO DECIDE THE LOCATION 


Test Phase 


OF SOLUTIONS TO PrE-, INTER-, AND PostTEST PROBLEMS 


Group II 


Group III 


All Problems 
Pretest 
Intertest 
Posttest 
Total test 


Problems Solved 
Pretest 
Intertest 
Posttest 
Total test 


Problems Failed 
Pretest 
Intertest 
Posttest 
Total test 


(initially poor, but improved) showed 
the greatest gain in mean number of 
problems solved when compared with 
Group I or III. However, the F of 21.09 
obtained from group performances over 
the series of 18 problems was statistically 
significant beyond the 1 per cent level in 
favor of Group I (good problem solvers). 

The consistent superiority of Group 
I Ss over the remaining two groups had 
at this point been established. ‘The single 
exception consisted of the posttest per- 
formance of Group II Ss, but the differ- 
ences between Group I and II Ss were 
not actually significant at this point. 
However, Groups I and II were signifi- 
cantly better than Group III on the post- 
test problems. 

The point is being made that the fore- 
going tests of significance clearly show 
Group I Ss to be sampled from a “differ- 
ent” population of problem solvers than 
either Group II or III. We are, of 
course, referring to problem-solving 
ability as it relates to the gear-train ap- 
paratus. We now approach the focal 
problem with which this paper is con- 
cerned. The central objective is the in- 


Mean SD 


56.60 
39.94 
32.54 
34.50 


49.61 
26.98 
18.63 
22.04 


68.18 
45.07 
43.76 
45-41 


vestigation of selected relationships be- 
tween well-defined response categories 
and problem-solving proficiency. The re- 
sponse categories that were examined are 
time, error distance, pattern of search, 
and behavioral indices of response stereo- 
typy- 

What we wish to learn is whether the 
response categories of time, error dis- 
tance, pattern of search, and amount of 
stereotypy are factors that describe the 
good problem solver when compared 
with the poor problem solver. 

2. Analysis of time scores. ‘The pur- 
pose of an analysis of time scores was to 
determine whether time is a significant 
factor in problem-solving proficiency. 
Stated in another way, does the good 
problem solver require significantly less 
time than the poor problem solver, 
when gear-train malfunctions are to be 
located? 

Table 2 shows the means and standard 
deviations of time in minutes required 
by each of three problem-solving groups 
to make a decision with respect to the 
location of each of a series of six prob- 
lems. Arriving at a decision was not nec- 


( 
7 
Group I | | 
Mean | SD Mean SD | a 
74.7. | 19.80 | 108.4 57-54 | 89.4 
61.3 26.07 | 79.2 51.42 52.6 
65.7. | 28.6: | 63.7 17.19 | 88-9 
| 67.2 20.22 | 84.0 30.72 | 65.4 
53-4 20,12 66.2 | 50.70 59.2 | : 
40.2 15.29 50.0 29.89 36.4 
38.4 15.35 52-4 | 14.42 39-3 
44.2 10.33 56.2 16.99 42.2 
100.1 43.15 115.4 | 60.47 | 102.6 
95.4 71.06 go.2 58.29 61.2 
110.1 69.62 | 84.2 | 30.33 | 64.5 
93-5 45-17 88.6 39.24 77.6 


N. A. FATTU, E. 


TABLE 3 
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ANALYSES OF VARIANCE OF TIME IN SECONDS REQUIRED TO DeciIDE THE LOCATION 


All Problems 
Source of 
hase Variance Mean 
af | Square F 
Pretest Between groups 2 140,639.50 | 1.44 
Within groups 46 97,715.52 | 
Intertest Between groups 2 114,728.01 2.13 
Within groups 46 | $3,904.21 
Posttest Between groups 2 25,613.26 0.87 
Within groups 46 29,303-75 
Total test Between groups a 2,484.00 2.22 
Within groups 46 1,116.78 


essarily indicative that the decision 
was a correct one, Data describing per- 
formance on the various test phases are 
shown in Table 2 in the form of means 
and standard deviations for (a) all prob- 
lems, whether passed or failed, (b) only 
those problems correctly solved, and (c) 
only those problems failed. 

An inspection of the mean times in 
Table 2, both under probiems solved 
and problems failed, shows a relationship 
between response latency (time in min- 
utes to arrive at a decision) and problem- 
solving success. This means simply that 
all Ss tended to require less time to 
arrive at correct solutions than to arrive 
at incorrect solutions. 

In order to determine whether these 
two differences among the groups were 
statistically different from zero a set of 
analyses of variance was computed. 

More specifically, 12 analyses of vari- 
ance were computed. This number was 
arrived at by testing for differences 
among (a) all problems, (b) problems 
solved correctly, and (c) problems failed 
for each of the test phases (pre-, inter-, 
post-, and total test). The results of these 
analyses are summarized in Table 3. 

Each of the 12 F ratios failed to reach 
significance at the 5 per cent level of 
confidence. The consistent lack of sig- 
nificant time difference among problem- 
solving groups is highly suggestive that 


MS 


Problems Solved Problems Failed 


Mean Mean | 


| 4 Square | P df | Square | F 
2 $13.03 | 0.20 | 2 | 1,000.46] 0.26 
At | 2,561.06 | | 46 | 3,901.38 | 
| | 
s | 732.57 | 1.05 | 2 6,041.70 1.78 
42 | 698.14 | 46 3,397.04 
2 | 930.00 | 3.18 2 115.64 0.04 
| 44 | 292.80 45 2,710.05 
a | 920.42 2.53 | 2 | 1,056.27 0.52 
46 | 367.03 | 46 | 2,020.73 | 


time is a dubious factor in the descrip- 
tion of the comparative properties of 
good and poor problem solvers, 

3. Analysis of error-distance dimen- 
sion. The purpose of analyzing error- 
distance scores was to study the relation- 
ship between this particular response 
dimension and problem-solving _profi- 
ciency. More specifically, it was desired 
to discover whether more proficient prob- 
lem solvers, although incorrect in their 
decision as to the exact location of a 
malfunction, were consistently less in 
error distance than the less proficient 
problem solvers. 

Table 4 shows the means and standard 
deviations of error distances for the three 
problem-solving groups with respect to 
three series of six problems each. These 
error distances are expressed in terms of 
distance of response given by S from the 
functional unit in which the malfunc- 
tion was actually located. 

Thus, error distance was a direct func- 
tion of the discrepancy (in terms of 
FU’s) between indication of the location 
of a malfunction and the correct location 
of that malfunction. When the location 
indicated by S and the correct location 
were identical, the error-distance score 
was, of course, zero. 

The mean error distances for the three 
groups show a steady decrease for the 
pre-, inter-, and posttest series of prob- 
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TABLE 4 
COMPARISON OF ERROR DISTANCE RESPONSES MADE By Ss CLASSIFIED ACCORDING 
PROBLEM-SOLVING PROFICIENCY 


Means and Standard Deviations 


Group I Group III 


Group II 


Test Phase - 
Mean | 


| Mean 


Mean 


Pretest 
Intertest 
Posttest 


Total test 


Analysis of Variance Results 


Test Phase 


Pretest Between groups 


Within groups 
Intertest Between groups 
Within groups 


Posttest 


, Between groups 
Within groups 
Between groups 
Within groups 


Total test 


* p<.os. 
** »<.o1. 


lems respectively. Group II problem 
solvers (initially poor, but improved) 
demonstrated the sharpest reduction in 
error distance between the pre- and post- 
test measures. The mean error distances 
for the total series of 18 problems show 
Group III (poor problem solvers) to 
possess the highest average total error 
distances and Group I (good problem 
solvers) to possess the least average error 
distance for the total series. It appears 
that an inverse relationship exists be- 
tween problem-solving proficiency and 
error distance. In other words, magni- 
tude of error appears directly related to 
problem-solving proficiency. In order to 
test whether these differences in error 
distance were statistically different from 
zero, analyses of variance were computed 
for each of the test phases (pre-, inter-, 
post-, and total test). All F ratios, as 
shown in Table 4, were significant at 


Mean Square 


.48 11.06** 


445.06 
103.04 


55 
21 


1,376 
124 


994. 
78. 


6,910.: 


the 5 per cent 
beyond. 

A further illustration of the obtained 
relationship between error distance and 
correct solution is shown in Table 5, 
which summarizes the results of the 
product-moment correlation coefficient 
computed between error distance and 
pass-fail performance. The three nega- 
tive correlation coefficients of —.61, —.68, 
and —.79 represent the relationships for 
the pre-, inter-, and posttest phases re- 
spectively. 


level of confidence or 


TABLE 5 


CORRELATION BETWEEN 
Error DISTANCE AND Pass-FaAtL 
PERFORMANCE 

Test Phase Product-Moment 
Pretest 
Intertest 
Posttest 


— 
— 68 
—.79 


13.6 | 7.22 31.0 13.02 10.78 
12.4 8.35 | 24.0 10.67 21.6 | 9.99 
4.9 3.79 | 9.3 8.90 19.7 10.08 
Pe 30.9 12.60 | 64.3 | 22.08 72.4 23.68 
Source of Variation df F 
2 
46 
| 
2 4.32* 
46 
2 
46 
| 2 | 14.75°* 
40 468.56 
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in unit number 11. 


Since “error distance”’ is used as a 
simple linear concept in the present 
study, one interpretation of the fore- 
going coefficients of correlation is that 
the error distance for the good problem 
solvers was less, while for the poor prob- 
lem solvers it was greater. The magnitude 
of these negative coefficients tends to in- 
crease from the pretest through the post- 
test. 

4. Analysis of “search pattern” pro- 
files. It has often been assumed that a 
good problem solver adopts a different 
way of attempting a solution than does 
the poor problem solver. In effect, the 
search patterns of good and poor prob- 
lem solvers have been thought to differ. 

The purpose, then, of an analysis of 
search patterns for the three problem- 
solving groups was to determine the re- 
lationship between this response dimen- 
sion and problem-solving proficiency on 
the gear-train apparatus. 

The gear train, it will be remembered, 
was divided into 25 functional units for 
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Fic. 2. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located 


the purpose of studying the combined 
search pattern of the three problem- 
solving groups. The meaning of search 
pattern in the present context is the 
frequency with which each group moved 
to each of the 25 FU’s when the malfunc- 
tion was located in only one of the 25 
FU’s. The present analysis, however, was 
not concerned with the order in which 
these responses occurred. The primary 
objective was simply to determine the 
relationships, by use of correlational 
methods, among the three response pro- 
files for each of the 18 malfunctions, 
respectively. 

An examination of Figure 2 provides 
a concrete illustration of what is meant. 
Figure 2 shows the comparative fre- 
quency, in terms of percentages of total 
responses, with which the three groups of 
problem solvers moved to each of the 
25 FU’s in the gear train, when mal- 
function number 1 was inserted in unit 
11. This location is indicated by a small 
arrow along the abscissa. As is evidenced 
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Fic. 3. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 


unit number 16. 


by the profiles, Group I (the good prob- 
lem solvers) tended to group a greater 
percentage of their responses in the vicin- 
ity of functional unit 11 than did the re- 
maining two groups. Product-moment 
coefficients of correlation were computed 
between the three groups, taken two at 
a time. Specifically, the correlation coeffi- 
cient was computed between the per- 
centage of their total responses that each 
group gave to each of the 25 FU’s. The 
distribution of these percentages was in 
this way compared for the three groups, 
taken two at a time. Negative coefficients 
of correlation were obtained between 
Groups I and II, and I and III. The 
magnitude of these coefficients was —.33 
(I and II) and —.og (I and III) respec- 
tively. However, the correlation coeffi- 
cient between Groups II and III was .76. 

With respect to problem number 1 on 
the pretest, these coefficients indicate 
that no positive correlation exists be- 
tween the pattern of search employed by 
the good problem solvers and the pattern 


displayed by the poorer problem solver. 
That Groups II and HI, both classed 
as poor problem solvers at this stage, 
highly resembled each other in search 
pattern is evidenced by the correlation 
coefficient of .76. 

Similarly, the correlation coefficients 
were computed between the percentage 
of their total responses that each group 
gave to each of the 25 FU’s, for each of 
18 malfunctions, the groups again being 
taken two at a time. 

Fifty-four product-moment correlation 
coefficients were computed; the results 
are shown in Table 6. 

Figures 3 through 7 show the compara- 
tive search patterns for the three prob- 
lem-solving groups on the remaining 
pretest problems. The search patterns 
for pretest problem number 1 have al- 
ready been shown in Figure 2. 

Figures 8 through 13 show the search 
patterns for the three problem-solving 
groups during the intertest phase, which 
included problems 7, 8, 9, 10, 11, and 12. 
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Fic, 5. Search patterns for three problem-solving groups expressed in terms of percentage of total 


responses made by each group to each of 25 gear-train units, when actually no “malfunction” was 
inserted. 
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TABLE 6 


PRODUCT- MOMENT CORRELATIONS FOR PERCENTAGE OF TUTAL RESPONSES GIVEN By THPEE 
GROUPS OF PROBLEM SOLVERS TO EACH OF 25 FUNCTIONAL UNITS 


Proficiency Pretest Problems 


Il vs. II —.33 .36 .790 .56 31 83 | .390 
I vs, IIT 52 | .60 
II vs. Ill -76 .62 .32 .92 30 | .67 


* “No defect” problem. 


Figures 14 through 19 show the com- 
parative patterns of search for the three 
problem-solving groups for each of the 
posttest problems. This includes prob- 
lems 13, 14, 15, 16, 17, and 18, 

A most interesting and unexpected 
finding is the trend of the correlation 
between the patterns of search of the 
three problem-solving groups to increase. 
An examination of Figures 2 through 19 
indicates a general tendency for the 
search patterns between the groups to 
become highly similar. The search 
patterns for these same groups were ex- 
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PERCENT OF TOTAL RESPONSES 


0.0 


t Extremely difficult malfunction in the differential gears. 


(Pre-, INTER-, AND PostTTESTt PROBLEMS) 


Intertest Problems Posttest Problems 


8 9 1o* inf 12 13 14 1s* 16t «17 18 
59 61 63 36 76 890 77 =) 58 93 97 
53 57 63 67 52 55 15 53 St 
66 59 40 .63 7 Si 50 47 $7 8o 77 


tremely different at the outset, as shown 
on the first few problems. Table 6, 
which presents the correlation coefh- 
cients for the search patterns, points up 
this trend very clearly. The magnitudes 
of the correlation coefficients are much 
higher on the posttest than on the pre- 
test. It is concluded that, in terms of 
behavioral movements, the poor prob- 
lem solvers tend to resemble the more 
proficient problem solvers after a num- 
ber of trials. In effect, the poor prob- 
lem solvers have, as they practiced, 
adopted a search pattern that is highly 
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Fic. 6. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 


unit number 8. 
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responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 12. 
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Fic. 8. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located 
in unit number 18. 
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responses made by each group to each of 25 gear-train units, when the “malfunction” is located 
in unit number 11. 
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responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 5. 
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responses made by each group to each of 25 gear-train units, when actually no “malfunction” was 
inserted. 
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Fic. 12, Search patterns for three problem-solving groups expressed in terms of percentage of total 


responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 8. 
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Fic. 13. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 11. 
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responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 20, 
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Fic. 15. Search patterns for three problem-solving groups expressed in terms of percentage of total 


responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
unit number 14. 
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responses made by each group to each of 25 gear-train units, when actually no “malfunction” was 
inserted. 
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Fic. 18. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25, gear-train units, when the “malfunction” is located in 
unit number 17. 
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similar to the search pattern used by the 
good problem solvers. 

However, in terms of correct solutions 
the good problem-solving group per- 
formed in a statistically superior manner 
to the poor problem-solving group 
throughout the entire test series. These 
data are highly suggestive that the re- 
sponse dimension of search pattern 
does not sufficiently differentiate be- 
tween various problem solvers. 

The tendency for Groups II and III to 
resemble the search pattern followed by 
Group I is shown in Figures 20 and 21. 
These figures show the trend of product- 
moment correlations between Groups I 
and II, and Groups II and III respec- 
tively over the pre-, inter-, and posttest 
trials. It should be indicated that the 
points on the ordinate are based upon 
the average correlation after overlapping 
sequences of three trials each were taken. 
This was done to reduce the trial-by- 
trial variation. Figure 22 shows corre- 


Fic. 19. Search patterns for three problem-solving groups expressed in terms of percentage of total 
responses made by each group to each of 25 gear-train units, when the “malfunction” is located in 
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lational trend data between Groups II 
and Ill. 
It is apparent from these trend graphs 
that, with respect to search patterns, the 
poor problem solvers (Groups ITI and ITT) 
tend to resemble the good problem 
solvers (Group 1) more than they do each 
other. 
It is apparent that, although the 


poor problem-solving group tended 
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Fic. 20. Trend of product-moment correlations 
between Groups I and II over the three test 
phases. The points on the ordinate represent 
average correlations after overlapping sequences 
of three trials each were taken, so that trial-by- 
trial variation might be reduced. 
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to behave like the good problem-solv- 
ing group with respect to search pattern, 
this increased resemblance did not imply 
any noticeable increase in number of 
correct gear-train solutions. 

5. Response stereotypy and problem- 
solving proficiency. It has been long 
assumed that an “inverse” relationship 
exists between problem-solving perform- 
ance and stereotypy of approach. More 
specifically, the good problem solver is 
thought to be less stereotyped than the 
poor problem solver. 

It was the purpose of the present 
analysis to compare stereotypy indices 
for the three groups of problem solvers, 
and determine whether the foregoing 
assumptions proved valid, i.e., whether 
good problem solvers are indeed less 
stereotyped than poor problem solvers. 

The index of behavioral stereotypy as 
developed by Miller and Frick (2, 3) was 
used in the analysis. 

This index of stereotypy is a measure 
of the predictability of any sequence 
(of length s) in a chain of responses. It 
is based on a characteristic of any one 
response (or of any sequence) in this 
chain, called its uncertainty (U). Clearly, 
this quality increases with the number 
of alternatives. A logarithmic function 
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Fic. 21. Trend of product-moment correlations 
between Groups I and IIL over the three test 
phases. The points on the ordinate represent 
average correlations after overlapping sequences 
of three trials each were taken, so that trial-by- 
trial variation might be reduced, 
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Fic. 22. Trend of product-moment correlations 
between Groups II and III over the three test 
phases. The points on the ordinate represent 
average correlations after overlapping sequences 
of three trials each were taken, so that trial-by- 
trial variation might be reduced. 


has been selected to represent this U, 
because it is necessary to have a directly 
additive measure of uncertainty which 
would assign the same amount of un- 
certainty to all successive choices from a 
alternatives, assuming all choices to be 
equally probable. U(a) is derived to be 
Klog,(a), where a is the number of 
alternatives. Any case of unequal proba- 
bilities is then proved to be reducible 
to a case of equal probabilities by the in- 
sertion of a proper multiplying con- 
stant. Thus, U(a) = cKlog,(a), where 
o<c<1, regardless of the equality or 
otherwise of probabilities. 

Miller and Frick have chosen the 
logarithmic function to the base 2 prin- 
cipally because they choose to talk of 
uncertainty in terms of bits (binary 
digits). This is not crucial, since the in- 
dex of stereotypy, C,, is defined as equal 
to 1—(relative U,), where (relative U,) = 
U,/U maz: Umaz is obtained by assuming 
all responses independent and equally 
frequent. 

Table 7 summarizes the results of the 
stereotypy analysis, showing the stereo- 
typy index for each of three problem- 
solving groups over the pre-, inter-, and 
posttest phases. Stereotypy indices are 
shown also for total test performance. 
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Gear-TRAIN STEREOTYPY INDICES FOR SEQUENCES OF 1, 2, AND 3 RESPONSES 
FOR THREE Groups OF PROBLEM SOLVERS 


Sequence | 


Problem-Solving | 
Group Length Pretest 
I .0077 
(Good) 2 2942 
} 3 * 


II I .0089 


(Poor-Improved) 


it 
(Poor-Unimproved) 


3 


* Insufficient data. 


The asterisks in Table 7 indicate that 
an adequate number of responses was 
not available to compute  sterotypy 
indices for sequences of three responses. 
Therefore, for sequences of three re- 
sponses it was possible to compute only 
the total test stereotypy index for each 
of the three groups. To compute se- 
quences of three responses for the pre-, 
inter-, and posttest separately would have 
required in excess of 10,000 responses 
for each phase. 

The trend in stereotypy indices is for 
the good problem solvers to have a 
lower index than the poor problem 
solvers. These data lend quantitative 
weight to the assumption that poor 
problem solvers are more repetitive in 
their movements when compared with 
good problem solvers. These data are 
highly suggestive of the conclusion that 
stereotypy of behavior is a response di- 
mension that appears promising in dis- 
tinguishing between levels of problem- 
solving proficiency. 


SUMMARY AND CONCLUSION 
Progress in establishing relationships 
between environmental and _ response 
variables in problem solving demands 


Intertest | Posttest I otal 
Test 

.0068 | .0058 -0025 
-2220 | .2451 
° * . 2668 


first that attention be directed toward 
development of response measures other 
than time and number of correct solu- 
tions. A step in this direction was taken 
by comparing good and poor prob- 
lem solvers on three additional response 
dimensions. 

The investigation was divided into a 
pretest, intertest, and posttest phase. 
Forty-nine adult Ss were individually 
given six problems to solve during each 
of these foregoing phases. It was first 
necessary to demonstrate that Ss classi- 
fied as good problem solvers were more 
proficient than those classified as poor. 
Solution of three or more of the six 
pretest problems was a requirement for 
the good group. The poor group in- 
cluded all others. This latter group was 
then subdivided into two groups on the 
basis of the difference between their 
pretest and posttest scores. Those who 
demonstrated an improvement of at least 
two malfunctions between the pretest 
and the posttest were classified into 
Group Il, “poor improved” problem 
solvers. The remaining subjects were 
placed in Group III and referred to as 
“poor unimproved” problem solvers. 
Differences between groups were estab- 


| 
.0021 .0148 
3 * * * | +3025 
1 .0130 .0055 .0037 .0068 
2 . 3601 3232 -3453 
* | * - 2979 
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lished beyond the 1 per cent level of con- 
fidence. 

A gear train, consisting of two series 
and four parallel channels into which 
problems were easily inserted, was the 
apparatus. 

Failure of the panel to illuminate 
after the control handles were operated 
indicated to S that the apparatus was 
defective; the problem was to find the 
defect. Training factors were common 
to all Ss. Standard operating procedure 
instructions were given before the pre- 
test. Immediately following the pretest, a 
tape-recorded basic knowledge lecture 
concerning the nomenclature of the gear 
train was given to all Ss, This was fol- 
lowed immediately by intertest. 
After a 24-hour interval a_problem- 
solving lecture specific to the gear train 
was administered. This problem-solving 
lecture was given just prior to the post- 
test. All 66 moving parts of the appa- 
ratus were numbered, and Ss were re- 
quired to call out the numbers of all 
parts as they went from part to part in 
the process of attempting a solution. 

In addition to time measures, the 
groups were compared with respect to 
(a) error distance, (b) stereotypy of re- 
sponse on each trial over 18 trials, and 
(c) “pattern of search” for each of 18 
trials. 

The following results were obtained: 

1. Time. Analyses of time data were 
computed for (a) all problems, whether 
passed or failed, (b) only those prob- 
lems correctly solved, and (c) only those 
problems failed. None of the 12 F ratios 
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so obtained were significant, suggesting 
that time may be a dubious criterion of 
problem-solving proficiency. 

2. Error distance. A strong inverse 
relationship was found to exist between 
magnitude of error and problem-solving 


proficiency. The following product- 
moment correlations were obtained: 
pretest, —.61; intertest, —.68; posttest, 
—-79- 

3. Pattern of search. Correlation coefh- 
cients between group patterns increase 
as a function of number of trials. Poor 
problem solvers “searched” increasingly 
like good ones, but remained inferior in 
performance. 

4. Response stereotypy. The Miller- 
Frick index indicated that the poor 
problem solvers are consistently more 
stereotyped in their problem-solving be- 
havior than the good problem solvers. 
Whether these differences were “signifi- 
cant” is unknown since the authors knew 
of no existing test of significance to 


apply. 
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